Sign Language Recognition and Translation with Kinect
نویسندگان
چکیده
Sign language (SL) recognition, although has been explored for many years, is still a challenging problem for real practice. The complex background and illumination conditions affect the hand tracking and make the SL recognition very difficult. Fortunately, Kinect is able to provide depth and color data simultaneously, based on which the hand and body action can be tracked more accurate and easier. Therefore, 3D motion trajectory of each sign language vocabulary is aligned and matched between probe and gallery to get the recognized result. This demo will show our primary efforts on sign language recognition and translation with Kinect. Keywords-sign language; hand tracking; 3D motion trajectory
منابع مشابه
Interpreting American Sign Language with Kinect
Accurate and real-time machine translation of sign language has the potential to significantly improve communication between hearing impaired people and those who do not understand sign language. Previous research studies on computer recognition of sign language have taken input from technology including motion-capturing gloves and computer vision combined with colored gloves. These projects co...
متن کاملPersian sign language detection based on normalized depth image information
There are many reports of using the Kinect to detect hand and finger gestures after release of device by Microsoft. The depth information is mostly used to separate the hand image in the two-dimension of RGB domain. This paper proposes a method in which the depth information plays a more dominant role. Using a threshold in depth space first the hand template is extracted. Then in 3D domain the ...
متن کاملSign Language Recognition with Kinect
A framework for general gesture recognition is presented and tested with isolated signs of sign language. Other than common systems for sign language recognition, this framework makes use of Kinect, a depth camera developed by Microsoft and PrimeSense, which features easy extraction of important body parts. Recognition is done using hidden Markov models with a continuous observation density. Th...
متن کاملBuilding an Application for Learning the Finger Alphabet of Swiss German Sign Language through Use of the Kinect
We developed an application for learning the finger alphabet of Swiss German Sign Language. It consists of a user interface and a recognition algorithm including the Kinect sensor. The official Kinect Software Development Kit (SDK) does not recognize fingertips. We extended it with an existing algorithm. Posted at the Zurich Open Repository and Archive, University of Zurich ZORA URL: https://do...
متن کاملSign Language Recognition with the Kinect Sensor Based on Conditional Random Fields
Sign language is a visual language used by deaf people. One difficulty of sign language recognition is that sign instances of vary in both motion and shape in three-dimensional (3D) space. In this research, we use 3D depth information from hand motions, generated from Microsoft's Kinect sensor and apply a hierarchical conditional random field (CRF) that recognizes hand signs from the hand motio...
متن کامل